The Description of the NTOU RITE System in NTCIR-10
نویسندگان
چکیده
The textual entailment system determines whether one sentence entails another in common sense. This is the second time of a RITE task in NTCIR projects. Three different subtasks, BC, MC, and RITE4QA, were held this time. We proposed several new features, and tried to construct RITE systems by using binaryor multi-class classifiers. After correcting errors in our submitted runs, our best (unofficial) system in the BC subtask achieves 65.12% in macro F-measure and 66.52% in accuracy. The performance of our MC classifiers is around 44.8% in macro F-measure and 56.64% in accuracy. Our best (unofficial) system in the RITE4QA subtask achieves 32.67% in Top1 accuracy, 41.74% in MRR, and 56% in Top 5 accuracy regarding to the WorseRanking. KEYWORD NTOU, RITE, Traditional Chinese, BC and MC subtasks, RITE4QA, WordNet, Sinica BOW, Wikipedia
منابع مشابه
The Description of the NTOU RITE System in NTCIR-9
The textual entailment system determines whether one sentence can entail another in a common sense. We proposed several approaches to train textual entailment classifiers, including setting ancestor distance threshold, expanding training corpus, using different sets of features, and tuning classifier settings. The results show that a MC classifier trained by using an expanded training corpus an...
متن کاملDescription of the NTOU RITE-VAL System at NTCIR-11
System validation subtask in NTCIR aims at developing techniques to deal with many kinds of language phenomena about textual entailment. This paper introduces our system participating in NTCIR-11 RITE-VAL SV Subtask. By adopting different combination of features related to WordNet, Tongyici Cilin, and syntactic information, 5 SV-BC and 5 SV-MC formal runs were submitted. The best BC run achieve...
متن کاملDescription of the NTOU Complex QA System
We participated in NTCIR-8 CCLQA Task for Chinese-to-Chinese (C-C) and English-to-Chinese (E-C) tasks. This is our first time developing a QA system for complex questions, although we already have some experiences on handling BIOGRAPHY, DEFINITION, and WHY questions. This paper provides the description of our complex QA system, the NTOU XQA System participated in NTCIR-8 CCLQA Task. This QA sys...
متن کاملExperiments for NTCIR-11 RITE-VAL Task at Shibaura Institute of Technology
This paper reports the evaluation results of our textual entailment system at NTCIR-11 RITE-VAL task. We participated in the Japanese System Validation (SV) and Fact Validation (FV) subtasks. In our system, the meaning of a text is represented as a set of dependency triples consisting of two words and their relation. Comparing two sets of dependency triples with respect to conceptual similarity...
متن کاملBinary-class and Multi-class Chinese Textural Entailment System Description in NTCIR-9 RITE
In this paper, we describe the details of our system for NTCIR-9 RITE. We sent 3 runs for each of the four sub-tasks: CT-BC, CTMC, CS-BC, and CS-MC. Our approach to the NTCIR-9 RITE task is based on the standard supervised learning classification. We integrate available computational linguistic resources of Chinese language processing to build the system in a statistical natural language proces...
متن کامل